Graph convolutional neural networks with node transition probability-based message passing and DropNode regularization

نویسندگان

چکیده

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a message passing motif; features nodes are passed around neighbors, aggregated and transformed produce better nodes’ representations. Nevertheless, these seldom use node transition probabilities, measure that has been found useful exploring graphs. Furthermore, when probabilities used, direction is often improperly considered feature aggregation step, resulting an inefficient weighting scheme. In addition, although great number GCNN models with increasing level complexity introduced, GCNNs suffer from over-fitting being trained on small Another issue over-smoothing, which tends make representations indistinguishable. This work presents new method improve process based by properly considering direction, leading scheme compared counterpart. Moreover, we propose novel regularization termed DropNode address over-smoothing issues simultaneously. randomly discards part graph, thus it creates multiple deformed versions data augmentation effect. Additionally, lessens connectivity mitigating effect deep GCNNs. Extensive experiments eight benchmark datasets for graph classification tasks demonstrate effectiveness proposed comparison state art.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Convolutional neural networks with low-rank regularization

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have been used for speeding up CNNs. In this paper, we further develop the tensor decomposition technique. We propose a new algorithm for computing the low-rank ten...

متن کامل

Convolutional Neural Networks Via Node-Varying Graph Filters

Convolutional neural networks (CNNs) are being applied to an increasing number of problems and fields due to their superior performance in classification and regression tasks. Since two of the key operations that CNNs implement are convolution and pooling, this type of networks is implicitly designed to act on data described by regular structures such as images. Motivated by the recent interest...

متن کامل

Mapping Neural Networks onto Message-Passing Multicomputers

This paper investigates the architectural requirements for simulating neural networks using massively parallel multiprocessors. First, we model the connectiv-ity patterns in large neural networks. A distributed processor/memory organization is developed for eeciently simulating asynchronous, value-passing connection-ist models. Based on the network connectivity and mapping policy, we estimate t...

متن کامل

Graph Classification with 2D Convolutional Neural Networks

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To address this challenge, many sophisticated extensions of CNNs have recently been introduced. In this paper, we reverse the problem: rather than proposing yet...

متن کامل

Mapping Neural Networks onto Message - Passing

This paper investigates the architectural requirements for simulating neural networks using massively parallel multiprocessors. First, we model the connectivity patterns in large neural networks. A distributed processor/memory organization is developed for efficiently simulating asynchronous, value-passing connectionist models. On the basis of the network connectivity and mapping policy, we est...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Expert Systems With Applications

سال: 2021

ISSN: ['1873-6793', '0957-4174']

DOI: https://doi.org/10.1016/j.eswa.2021.114711